Scheduling Job Queue on Hadoop using Hybrid Hadoop Fair Sojourn Protocol

HFSP: The Hadoop Fair Sojourn Protocol

This work presents the HFSP scheduler, which implements a size-based scheduling discipline for Hadoop. While the benefits of size-based scheduling disciplines are well recognized in a variety of contexts (computer networks, operating systems, etc...), their practical implementation for a system such as Hadoop raises a number of important challenges. In HFSP we address issues related to job size...

Research on Job Scheduling Algorithm in Hadoop

On the basis of researching Fair Scheduling Strategy deeply in Hadoop cluster,the Node Health Degree is defined by constructing the relationship function between node load and job fail rate, and a job scheduling algorithm based on Node Health Degree is proposed in this paper. Nodes are grouped, according to Node Health Degree, into three categories in order to assign corresponding job in accord...

Job Attentive Scheduling Algorithm in Hadoop

In recent years cloud services have gained much attention as a result of their availability, scalability, and low cost. One use of these services has been for the execution of scientific workflows as part of Big Data Analytics, which are employed in a diverse range of fields including astronomy, physics, seismology, and bioinformatics. There has been much research on heuristic scheduling algori...

A Hadoop Job Scheduling Algorithm Based on Pagerank

Aiming at the problem that the job scheduling algorithm based on the classical model of cloud computing in Hadoop is not high, the new job scheduling algorithm based on PageRank algorithm is proposed, Under the premise of ensuring the user experience, we propose a new job scheduling algorithm named ValidRank, which is based on the combination of hierarchical weight and waiting time. Then for th...

A Review on HADOOP MAPREDUCE-A Job Aware Scheduling Technology